ON THE SYMMETRIC SQUARE. 
UNSTABLE TWISTED CHARACTERS 
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^ Abstract. We provide a purely local computation of the (elliptic) twisted (by 

"transpose-inverse") character of the representation tt = 1(1) of PGL(3) over 
Q I a p-adic field induced from the trivial representation of the maximal parabolic 

■ subgroup. This computation is independent of the theory of the symmetric square 
lifting of [IV] of automorphic and admissible representations of SL(2) to PGL(3). 
It leads — see [FK] - to a proof of the (unstable) fundamental lemma in the theory 
of the symmetric square lifting, namely that corresponding spherical functions (on 
PGL(2) and PGL(3)) are matching: they have matching orbital integrals. The 

I new case in [FK] is the unstable one. A direct local proof of the fundamental 

■ lemma is given in [V]. 

d ■ 

This work continues the paper [FK], whose notations we use. Our aim is to 
prove Proposition 1 of [FK] without using Theorem there. Namely we provide 
>■ ' a purely local computation of the twisted character of tt = /(I). Our model 
^ ■ of TT is that of [FK], where the twisted character Xtt is computed directly and 
! locally but only for the anisotropic twisted conjugacy class d' (see [FK], proof of 
'vh I Proposition 1). In [FK] the value on the isotropic twisted conjugacy class 5 is 
deduced from the global Proposition 2.4 of [IV] - recorded in [FK] as Theorem 
- which asserts that Xiri^) = —Xiri^')- 
O ■ While the proof of Proposition 2.4 of [IV] is independent of the results of [FK] 

(Theorems 1, 2, 3, 3', which follow from Proposition 1), it is global, and so might 
lead some readers to worry that a vicious circle is created. Moreover, the proof of 



>< 



;h ' this global result requires heavy machinery. Here we provide a purely local proof 
of Proposition 1 of [FK] , and consequently make the results of [FK] independent 
of Proposition 2.4 of [IV] (= Theorem of [FK]). 

Of course the conventional approach is to deduce the character computation of 
[FK], Proposition 1, on using the global trace formula comparison ([IV]) which 
is based on the fundamental lemma, proven purely locally in [V]. The novel 
approach of [FK] - which we complete here - is in reversing this perspective, and 
using the global trace formula to prove the (unstable) fundamental lemma from 
a purely local computation of the twisted character in a special case. 
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Further, an independent, direct computation of the very precise character cal- 
culation gives another assurance of the validity of the trace formula approach 
to the lifting project. It will be interesting to develop this approach in other 
lifting situations, especially since our technique is different from the well-known, 
standard techniques of trace formulae and dual reductive pairs. A first step in 
this direction was taken in our work [FZ] , where the twisted - by the transpose- 
inverse involution - character of a representation of PGL(4) analogous to the 
one considered here, is computed. The situation of [FZ] is new, dealing with 
the exterior product of two representations of GL(2) and the structure of repre- 
sentations of the rank two symplectic group. Such character computations are 
not yet available by any other technique. However, the computations of [FZ] - 
although elementary - are involved, as they depend on the classification of [F] 
of the twisted conjugacy classes in GL(4). This is another reason for the present 
work, which considers the initial non trivial case of our technique - where the 
computations are still simple and can clarify the method. We believe that our 
methods, pursued in [FZ] in a more complicated case, would apply in quite gen- 
eral lifting situations, in conjunction with, and as an alternative to the trace 
formula. 

Proposition 1 of [FK] asserts that if 1 is the trivial PGL(2,F)-module, n — /(I) 
is the PGL(3,F)-module normalizedly induced from the trivial representation of 
the maximal parabolic subgroup (whose Levi component is GL(2,F)), and 5 is 
a cT-regular element of PGL(3,F) with elliptic regular norm 71 = NiS, then 

The proof of Proposition 1 in [FK] reduces this to the claim that the value at 
s = of 

Jv° 

is -K,{5)q~^/^{1 + q~^l'^ -V q~^) (see bottom of page 499, and Lemma 2, in [FK]). 

This equality is verified in [FK], p. 499, when the quadratic form x^+uy^ — $z'^ 
is anisotropic, in which case k{5) = —1 and the integral converges for all s. 

Here we deal with the case where the quadratic form is isotropic, in which 
case k{S) — 1, the integral converges only in some half plane of s, and the value 
at s = is obtained by analytic continuation. 

Recall that F is a local non-archimedean field of odd residual characteristic; 
R denotes the (local) ring of integers of F: tt signifies a generator of the maximal 
ideal of R. Denote by q the number of elements of the residue field R/irR of R. 
By F we mean a set of representatives in R for the finite field R/ir. The absolute 
value on F is normalized by |7r| = q~^. 

The case of interest is that where K = F{\/9) is a quadratic extension of F, 
thus 6 G F^ — F^"^. Since the twisted character depends only on the twisted 
conjugacy class, we may assume that 16*1 and 1^1 lie in {1, g~^}. 

0. Lemma. We may assume that the quadratic form -|- uy"^ — Oz^ takes one 
of three avatars: — Oz"^ — , Q ^ R — R? ; — "kz^ + Try^; or x^ — itz^ — . 

Proof. (1) If KjF is unramificd, then \Q\ = 1, thus 9 G R^ — R^^. The norm 

„ AT T^X ;„ _2ZdX Jf ™2 fl^2 I ,.,.2 j-„ n ^-^ „. ^ DX Jf 
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— 1 is not a square, thus 6 = —1, then u is —1 (get x'^ — z'^ — y"^) or tt = 1 (get 
- + y^, equivalent case). If -1 e R^^, the case of u = d {x^ - dz^ + 9y^ = 
6{y^ + 0~^x'^ — z"^)) is equivalent to the case of tt = —1. So wlog u = —1 and the 
form is — Oz"^ — y^, \uO\ — 1. 

(2) If K/F is ramified, \e\ = q'^ and Nk/fK"" = {-OfR''^. The form x^ - 
9z^ + uy^ represents zero when —u e R^^ or —u e —OR^"^. Then the form looks 
like x"^ — dz^ + with u = $ and l^^l = q~^, or - 9z^ - y^ with u = -1 and 
|^tt| = q'"-'^. The Lemma follows. □ 

We are interested in the value at s = —3/2 of the integral Is{u,9) of \x^ + 
uy^ — 9z'^\^ over the set F° = V/ ~, where 

V = {y= {x, y, z) e R^; max{|a;|, \y\, \z\} = 1} 

and ~ is the equivalence relation v ~ av for a E R^ . 
The set is the disjoint union of the subsets 

v^ = v^{u,e) = Vn{u,d)/^, 

where 

Vn = Vn{u, 9) = {v; max{|a;|, \yl \z\] = 1, \x'^ + uy^ - Oz'^l ^ l/q""}, 

over n > 0, and of {v; x'^ + uy'^ — dz^ = 0}/ ~, a set of measure zero. 
Thus we have 

oo 

Is{u,Q) = Y,q-^'No\{Vl{uM- 

Theorem. The value of \ue\^/^Is{u,e) at s ^ -3/2 is -q-^/^{l + q'^/^ + q'^). 
The problem is simply to compute the volumes 

Vol{V^{u, 6)) = Vol(V;,(^i, e))/{l - l/q) (n > 0). 

1. Lemma. When $ = ir and u = —1, thus \u9\ = l/q, we have 

{ (1-1/g), ^/n = 0, 

Yo\{V^) = I 2q-\l - l/q) + l/q\ if n = 1, 

[ 2g--(l-l/g), ifn>2. 

Proof. Recall that 

Vo = Vo(-l,7r) = {{x,y,z); max{|a;|, \y\, \z\} = 1, - -irz"^] = 1}. 
Since \z\ < 1, we have Ittz^I < 1, and 
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Thus \x — y\ — \x -\- y\ = 1, and if \x\ 7^ \y\, \x ± y\ — max{|a;|, \y\}. We split 
Vq into three distinct subsets, corresponding to the cases |a;| = \y\ = 1; |a;| = 1, 
\y\ < 1; and \x\ < 1, \y\ = 1. The volume is then 



Vol(Vb) = 



z <1 ^ a; =1 



\y\ = ^,\x-y\ = \x+y\ = l 



dydxdz 



+ 



z\<l 



+ 

x\^lJ\y\<l ^|x|<l^|y|=l 



dydxdz 



x\ = l 



|j/| = l,|a;-j/| = |a;+J/|=l 



2 / 1 

dydx H — 1 

q\ q 



To consider the Vn with n > 1, where — — Trz'^\ = recall that any 

p-adic number a such that |a| < 1 can be written as a power series in ir: 



a = a^TT* = ao + aiir + a2iT^ + ■■■ (a^ e F). 

i=0 

In particular |a| = l/q^ implies that oq = ai = ... = a„_i = 0, and a„ 0. If 

00 00 00 

X = ^XiTr\ y = ^yiTr\ Z = ^ ZiW' {Xi, yi, Zi & ¥) , 
i=0 i=0 

then 



i=0 



i=0 



a; 



i=0 



i=0 



i=0 



where 



Cbi — XjXi—j , hi — ^ ] VjUi—j i — ^ ^ ^j^i—j (^*) ^ 

i=o i=o j=o 

We have 

x'-y'-Trz' = Y,fi'^' (/. eF), 

where /o = oo — ^0, fi = 0'i — bi — Q-i > !)• Since — — t^z'^\ = 1/q^ , we 
have that /o = /i = ... = fn-i — 0, and fn 7^ 0- Thus we obtain the relations 
(for a, b, c in the set F, which (modulo tt) is the field R/w): 

ao-bo = 0, ai-bi-Ci-i = (z = 1, n - 1), a„ - 6^ - c„_i 7^ 0. 

Recall that together with max{|a;|, \y\, \z\} = 1, these relations define the set Vn- 
To compute the volume of Vn we integrate in the order: ...dydzdx. From 
<^o ~ ^0 = it follows that yo = ±xo, and from ai — bi — Cj_i (z > 1) it follows 
that 

i-l 



2yo2/i = ai- Ci^x -^yjyi_j, 
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where in the case of z = 1 the sum over j is empty. 

Let n > 2. When i = 1 we have 2xqXi — 2j/o?/i — Zq = {i. So if = (in 
i?/7r, i.e. < 1), it follows that yo = and zq = Q (i.e. \y\ < 1, \z\ < 1). This 
contradicts the fact that max{|a;|, |y|, 1^1} = 1. Thus |a;| = 1. In this case j/o 7^ 
and (for n > 2) we have: 



Voi(v;,) 



/ / 




/\x\^l J\z\<l 





dzdx, 



where the variable y is such that once written as y ~ yo + yiir + y2'^^ + 
it has to satisfy: yo = ±xq, and yi {i ~ 1, ...,n — 1) is defined uniquely from 
tti — bi — Ci-i = 0, and j/n 7^ some value defined by an — bn — Cn-i 7^ 0. Thus 
when n > 2, 



2 V 2 / 1^ ^ 



Vol(K) = - - 1-- =- 1-- 

Let n = 1. When i = 1 we have 2xqXi — 2yoyi — Zq 0. So if = (i.e. 
< 1), it follows that yo = and zq (i.e. we have an additional contribution 
from \x\ < 1, \y\ < 1, \z\ — 1). Thus, 

The Lemma follows. □ 
2. Lemma. When u and 9 equally, thus \u9\ — we have 

1, ifn=0, 
Yo\iV^)={ q-\l-l/q), if n = 1, 

2q-^{l-l/q), ifn>2. 

Proof. To compute Vol(Vb), recall that 

Vo = {ix,y,z);max{\x\, \y\, \z\} = 1, \x'^ +Tr{y'^ - z'^)\ = 1}. 
Since \y\ < 1, \z\ < 1, we have |a;^ +^(y^ — z^)\ = |a;^| = 1, and so 

Vol(Vb) = / / / dxdydz = 1 - - . 

•^|a|<l •^|J/|<1 -^kNl ? 

To compute Vol(V^), n > 1, recall that 

Vn = {{x, y, z); max{|a;|, \y\, \z\} = 1, \x^ + TT{y^ - ^^)| = l/g"}- 

Following the notations of Lemma 1 we write 

00 

+ ir{y'-z') = J2f,ir' (/, e F), 



x^ 
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/ / 


J". 


dzdx 


/|a;|<l J\z\=l 







where /o = ao and fi — ai + bi-i — Ci-i {i > 1). The condition which defines Vn 
is that /o = /i = ••• = /n-i = and fn ^- The equation /o = imphes that 
xq = (i.e. \x\ < 1). We arrange the order of integration to be: ...dydzdx. 

When n > 2, since = 0, /i = imphes that Vq — Zq = 0. Using 
max{|x|, \y\, \z\} = 1 we conclude that i/q — ±zq 7^ (i.e. \z\ = 1, \z'^ — y'^\ < 1). 
Thus we have 

Vol(K) 

where the variable y is such that once written as j/ = j/o + J/i^ + + 
it has to satisfy: yo = ±zo, and j/j (i = 1, ...,n — 2) is defined uniquely from 
tti + bi-i — Ci-i = 0, and j/n-i 7^ some value defined by + 6n-i — c^-i 7^ 0. 
Thus when n > 2, 

When n = 1 we have /o = 0, /i 7^ 0. These amount to xq = 0, 2/0 7^ ±^o- 
Separating the two cases zq = 0, and zq 7^ 0, we obtain 



Vol(Fi)= [ [ [ dydzdx + [ [ [ 

J\x\<l J\z\<l J\y\ = l J\x\<l J\z\=l J\y^-z^\=l 



dydzdx 



\y 

The Lemma follows. □ 
3. Lemma. When K/F is unramified, thus \u9\ = 1, we have 

/ 0\ f ^/'^ = 0, 

VoKK ) = I _ ^^^^^^ ^ ^^^^^ .^^ ^ 

Proof. First we compute Vol(Vo). Recall that 

Vb = {{x,y,z);max{\x\, \y\, \z\} = 1, \x'^ - - 6'2;^| = 1}. 

Since |a;^ — y^ — < max{|a;|, |y|, |2;|}, 

V^) = {{x, y, z) e i?^ \x^ -y^-ez^\ = 1}. 

Making the change of variables u = x + y, v = x — y, we obtain 

Vq = {{u,v,z) e R^; \uv-ez^\ = 1}. 

Assume that \uv\ < 1. Since \uv — 6z'^\ = 1, it follows that \z\ = 1. The 
contribution from the set \uv\ < 1 is 



/.J/,./,..-/../ 



dudvdz 
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Assume that \uv\ = 1, i.e. \u\ = \v\ = 1. We arrange the order of integration 
as: dudvdz. If \z\ < 1 then \uv — 9z'^\ = \uv\ = 1. If \z\ = 1 we introduce 
U{v,z) = {u; \u\ = 1, \uv — Oz'^l = 1}, a set of volume 1 — 2/q, and note that 
the contribution from the set |uf | = 1 is 

// / dudvdz + / / dudvdz. 

^z\<l J\v\=l J\u\=l J\z\=l J\v\=l Ju(v,z) 

The sum of the two integrals is 



Adding the contributions from \uv\ < 1 and \uv\ = 1 we then obtain 



Vo,(V„) = - ^1 - -J ^2 - -J + ^1 - -J =1-^ 

Next we compute Vol(Fn)5 n>\. Recall that 

K = 2;);max{|a;|, \y\, \zW = 1, - - Oz'^\ = 1/g'^}. 

Making the change of variables tt = a; + y, v = a; — y, we obtain 

Vn = {{u,v, ^); max{|w + v\, \u — v\, \z\} = 1, \uv — dz^\ = 1/q^}. 

Since the set {v = 0} is of measure zero, we assume that v ^0. Then \uv — 9z'^ \ = 
l/qf" implies that u = 9z'^v~^ + tv~^TT^, where \t\ = 1. There are two cases. 

Assume that \v\ — 1. Note that if 1^1 = 1, then max{|tt + |it — ^;|, \z\} = 1 
is satisfied, and if \z\ < 1, then (recall that n > 1) 

\u\ = \Qz'^v-^ + iv-^^l < maxdz^l, g-^} < 1, 

and |w + f I = \v\ = 1. So \v\ = 1 implies max{|w + v\, \u — v\, \z\} = 1. Further, 
since \v\ = 1, we have du = q~^dt. Thus the contribution from the set with 
\v\ = 1 is 

dudvdz — I I I — dvdz — — [ 1 ) . 

,v\ = lJ\uv-ez^\=l/q'" J \z\<l J \v\ = l J \t\ = l Q'^ \ QJ 

Assume that \v\ < 1. Note that if \z\ = 1, since \u\ < 1 we have q~'^ = 
\uv — 9z'^\ = \0z'^\ = 1, a contradiction. Thus \z\ < 1, and in order to satisfy 
max{|M + |m — f 1, 1^1} = 1, we should have \u\ = 1. The contribution from the 
set with \v\ < 1 is 

[ [ [ dvdudz. 
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We write v = 6z^u ^ -\-tu -^tt", where \t\ — 1, and dv = q ^dt. The integral 
equals 



1 - - 

q 



p2 



[ [ [ — dudz — 

i|^|<i J|u|=i J|t|=i 9" QQ"" 

Adding the contributions from |v| = 1 and |v| < 1 we obtain 



The Lemma follows. □ 

This completes the proof of the theorem, so that we provided a purely local 
proof of (the character relation of) Proposition 1 of [FK] . We believe that analo- 
gous computations can be carried out in other lifting situations, to provide direct 
and local computations of twisted characters. As noted in the introduction, a 
step in this direction is taken in [FZ]. 
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